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(57) AbstTMl 

A muhinnedia pitsentatioo system is disclosed for coovdkiating access to multinnedia pcesentation data and related infionnation. 
TV nrohi^necUairaettiation data typically includes te^ Tlie related infonnation is stoied in an item header 

file, as wen as in a number (rf recoids. Tlie qrstem inchides a netw«Hk of oomputen indudii^ con^wten dedk»ted to 
tasb related to obtaining multi-media preaeii^tion data a^ To cootdfaiate nmlti-inedia presematioa i»ocess, 

Ibe abilify to modify content contained in an item fik Is limited wl^ 

same item file are separately available for other netwoik staff membcis. The system also geaentes watch recofds to notify staff members 
of the cuirent status (rf; availabOiQr of , or to pcDvide odier inf ofmatioQ rel^ 
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wo 99A)4370 PCTAJSW14474 
MULTI-MEDIA PROJECT MANAGEMENT AND CONTROL SYSTEM 



FIELD OF THE INVENTION 

The present invention relates to systems which manage the creation and 
5 editing of a multi-media presentation, which comprises a plurality of multi-media 
objects, by controlling the task assignments associated with the multi-media objects 
and, in particular, to a system that enables a plurality ofrdesigners, editors and 
managers to concurrently access both the multi-media presentations and their 
component multiHfnedia objects that are managed by this system. 

10 PROBLEM 

It is a problem in the magazine and newspaper publishing industry to 
manage and coordinate the efbrts required by the publication staff to produce the 
desired published document Publications are typically labor-intensive in that they 
require substantial effort from and coordination among:ithe publication staff 

15 members: designers, editors, project designers, art directors and publication 
managers. The publication managers direct the focusnof the publication and 
coordinate the publication process to ensure that deadlines are met. The project 
designers and art directors are concerned with the presentation of the publication, 
which includes page organization, layout, and image content The designers and 

20 editors are primarily concerned with the textual content of the publication. In the 
typical case, each page of the publication can undergo numerous revisions from 
any of the above mentioned staff members. Since many of the revisions provided 
by the staff members impact the woric products of other staff members, each 
revision to the content of the publication must be done in close coordination with 

25 all of the staff members. Thus, if the project designers change a page layout such 
that the space allocated for the text of an article changes, then the editor and/or 
designer responsible for that article is informed so that the article can be nxKJified 
to fit the new allocated area. It is therefore desirable to automate the publication 
process so that greater productivity gains can be realized and the staff members 

30 have tools adapted to the work products produced in the print document publication 
industry. 

U.S. Patent Application serial number08/375,163 discloses a layout driven 
publication management system that manages and coordinates access by staff 
members to the infonnation that relates to the publication Items which comprise the 



wo 99/04370 



PCTAJS98/14474 



printed publication. The publication infbnnation can include text, image data and/or 
layout data for a particular print nDedium publication item. Each publication item 
has a publication item file associated therewith that comprises: a file header of 
publication item infonnation, a content area that contains the publication item text 
5 or image data, and a geometry area that contains data which defines ttie location, 

orientation and shape of the layout area for this publication item. The publication n 

management system also includes a plurality of utilities that control publication item / oi 

data transfers among the network of interconnected processors used by the staff :>nn 

members. Such utilities include publication item file check-in and check-out utilities ten 

10 whereby a staff member is able to store or retrieve, respectively, a particular or 

publication item file. Additional utilities provkie notifications to staff members and ide 

answer queries of staff members related to publication item files such as a change put 
in the publication item file status or content 

A limitation of this publication management system is that it is architected ger 

15 solely for the print medium, with all of the above-noted components being layout ibo 

driven and directed to the management of the creation of text and graphics content ie c 

whk^h content is developed on a custom basis to fit the specified layout areas ^as 

assigned to the publication items which make up the resultant printed publication. :e 



Therefore, this implementation of the publication management system is not 
20 equipped to process multi-media presentations and their multi-media objects 
components, since multi-media is a content driven paradigm and the multi-media 
objects have characteristics that are not considered in this implementation of tiie 
pubik:ation management system. There is therefore a need in the field of multi- 
media presentations for a multi-media project management and control system that 
25 can perfonm multHmedia presentation management and control functions to thereby 
enable a team of multi-media developers to operate in close coordination, in a 
manner similar to that available in the print industry, to develop mutti-media 
projects. 

SOLUTION 

30 The above described problems are solved and a technk:al advance achieved 

in the field by the multiHfnedia project management and control system of the 
present inventfon which functions to manage the development of a multiHfnedia 
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presentation by controlling the task assignments associated with the retrieval, 
devebpment and integration of the plurality of multHmedia objects which comprise 
the multiHfnedia presentation. The multi-media presentation is content driven rather 
than layout driven as in the print medium case and the management of the multi- 
5 media project must follow this different paradigm. 

The multi-media project management and control system has a number of c : 
different data bases for storing multi-media object data and information related to 
such muttiHfnedia object data so that more than one staff member is able to ta 
simuttaneousty obtain information relating to a particular mutti-media object As a )ati< 

10 consequence, a number of different staff members involved in creating a multi- diff 
media presentation, including designers, editors, project designers, art directors c 
and multi-media presentation managers, can be working on the same multi-media n m 
presentation at the same time without interference. The mutti-media project ime 
management and control system maintains multi-media object records and sys 

15 provides notification infomiation and query responses that relate to the status ^tio 
and/or nxxllfication of any of the multi-media object files. Because such o 
notifications or query responses are automatically provided, updates are received se: 
by staff members in a timely manner and this ensures the accuracy of this ^iy 
infonr^ation relating to the multi-media object. ^1 ' i 

20 These multi-media object records include header records, each of which is -< 

a copy of a multi-media object file header associated with a particular multi-media 
object These header records are used by the multi-media project management 
and control system to grant staff members access to tiie corresponding multi-media 
object file. Each multi-media object header record includes information such as a 

25 check-out name fieW that klentifies the staff member that has the particular mutti- 
media object file checked-out for exclusive use, a status of the mutti-media object 
and a deadline date assodated with the multHmedia object as well as ottier mutti- 
media object infonnation. Each multi-media object also has an associated multi- 
media object summary record which includes a field for storing the klentity of the 

30 staff member that presentiy has exclusive use of the multi-media object header 
record, another field that indicates how the multi-media object header record and 
multi-media object file header are being used and a reference field related to 
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identification of staff members waiting for access to the particular multi-media 
object file that conresponds to the summary record. The multi-media project 
management and control system provides access to the multi-media object header 
5 record and the multi-media object summary record, for a particular mutti-media 
object file, to two different staff members at the same time, while yet another staff 
member is able to access the multi-media object file that is associated witti these 
two records. The multi-media project management and control sysfem also 
maintains watch records and detenmines whether a file notification o^a query 

10 notification should be provided to staff members due to one of a number of 
predetermined changes occurring to a multi-media object i cl 

These capabilities are available in the print medium for the dass^ of print 
items which include: articles, pictures, and layouts. However, the multi-media 
project management and control system extends these capabilities to multi-media 

15 objects by creating multi-media object file classes which sen^e the varidus multi- 
media objects, such as: run time movies, animation, pop-up menus, interactive 
queries, audio, moving objects, and any other dynamic data. These> additional 
classes are seamlessly incorporated into the publication contiol environment of 
print medium classes by the use of multi-media object file adminisb^tion processes 

20 which create custom headers for these multi-media objects and enable the staff 
members to define custom treatnr>ents for these new classes. The basic class 
structure of the print medium is ft>llowed by the multi-media project nr>anagement 
and control system and the dass transformations provided by this system enable 
the publication management environment of the print medium to be extended to the 

25 realm of multi-media presentations. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 illustrates a high level block diagram of the multi-media project 
management and control system; 

Fig. 2 illustrates a diagram of the woridlow for creating a multi-media 

30 presentation using the multi-media project nrianagement and control system; 
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Fig. 3 illustrates a more detailed block diagram of the project coordinator 
than is given inFtg. 1; 

Rgure 4 illustrates* in block diagram form, the overall architecture of a multi- 
media presentation generation system; and 

5 Fig. 5 illustrates, in flow diagram fomn, the operation of the multi-media 

presentation generation system in creating and viewing a multi-media presentation. 

DETAILED DESCRIPTION 
Figure 1 illustrates in block diagram form the majorarchitecturai components 
of the multi-media project management and control system 20 of the present 

10 invention. The multi-media project management and control system 20 typically 
comprises a plurality of networiced processors or workstations as is well known in 
the multi-media presentation generatfon industry. Thee various components 
described herein are implemented on ones of these probessors, and each staff 
member typically has a processor at which they perform their assigned tasks. The 

15 exact implementation of the hardware backbone of this system is secondary to this 
description and is noted herein where appropriate to clarify the description of the 
multi-media project management and control system 20.mu 

The multi-media project management and control system 20 includes a 
project coordinator 24 that coordinates the workflow between the staff nrtembers 

20 who are responsible for the various portions of a multi-media presentation 
development effort In particular, the project coordinator 24 manages and 
communicates wortc products anfK>ng staff members by providing a centralized 
repository for all multi-media objects in file server 28. Access to this library of multi- 
nDedia objects is coordinated through a check-in/check-out mechanism in the 

25 project coordinator 24 In combination witi) a notification mechanism that notifies 
staff members of multi-media presentation changes that can effect their work 
products. The project coordinator 24 includes a file server 28, a data contifoller 32 
and a collection of utility programs 36. The file server 28 provides access to all 
persistent file storage for communally accessed multi-media objects. The data 

30 controller 32 contanols the access to all multi-media object files ttiat reside on ttie file 
server 28. In addition, tiie data controller 32 also provides staff members witti 
multi-rpedia object description information (^le notification"). This notification 
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mechanism automatically notifies staff memt>ers of changes to a specific multi- 
nnedia object file and enables staff members to input a query notification that 
designates multi-media object changes that are to be monitored. Utility programs 
36 provide the high level functionality of the project coordinator 24 such that the 

5 project coordinator 24 can be viewed as a data server of a client-server software ' 

architecture. Thus, software processes requesting project coordinator 32 service q^^ 

are considered "dient applications" which make requests of the project coordinator nnf 

24 via the utility programs 36. The utility programs 36: communicate with the data pro 

controller 32 to control access to multimedia object files supplied by the file server ^dic 

10 28 and provide staff member client applications with an interface to receive >pli 

notification of nujiti-media presentation changes: communicate with the file server nar 

28 to read and write multinmedia object files; and transfer multi-media object :t fi 

information to^m staff members via presently executing client applications, ^se 

The multi-media project management and control system 20 also includes len 

15 at least the following dient applications: a project application software unit 44. a a r 

multi-media object assignment unit 40. and an editing unit 52 and at least one ant 

instance of a multi-media presentation generation system MPG. The project ge 
application software unit 44 can be any multi-media presentation project application ti 



which communicates with the other software programs of the multi-media project 
20 management and control system 20. The multi-media object assignment unit 40 
allows an assignor (a project designer or a manager) to assign a multi-media object 
to a designer/editor or to change various assignment attributes, such as due date 
and due time. Text editing unit 52 is used to create and modify ttie text of a multi- 
media object and indudes a multi-media object retrieval unit 56, a user interface 60 
25 and a text editor 64. The multi-media object retrieval unit 56 retrieves, and 
optionally checks-out for exdusive use, mufti-media objects from ttie project 
coordinator 24. In addition, the multi-media object retrieval unit 56 issues requests 
to display each retrieved multi-media object, via a user interface 60. to the 
designer/editor. To accomplish this, multi-noedia object request information flows 
30 from the designer/editor to the user interface 60 and on to the multi-media object 
retrieval unit 56 for multi-media object retrieval from ttie project coordinator 24. 
Once the multi-media object is retrieved, display options are set and ttie muW- 
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media object is presented to the user internee 60 to be displayed. The multi-media 
object retrieval unit 56 is also connected to a plurality of editing components which 
are illustrated as the text editor 64A, picture editor 64B, movie editor 64C, sound 
editor 64D to optionally edit the multi-media object The editors 64A-D are 
5 interactive editors that enables a designer/editor to modify an existing multi-media 
object retrieved from the file server 28. These elements can be commercially i*e 
available editing tools which are installed on various ones of the processors which ) ar 
comprise the network which is used to implement the multi-media project lich 
management and control system 20. Attematively, some of the functionality sy^ 

1 0 associated with these editors is available in the multi-media presentation generation s is 
system MPG, as is described below. The specific implementation of the editing ed 
elements is a matter of design choice and both options are disclosed herein to sig 
illustrate the capabilities of the multi-media project management and control >f tt 
system 20. In addition to displaying the multi-media object to the designer/editor, spl 

15 the user interface 60 also, at the request of tiie designer/edrtor» can check-in a at 
modified verston of a previously checked-out multi-media object file to the project )us 
coordinator 24. 

Types of Media - Multi-media project and Management System idl 

The multi-media project management and control system 20 processes >^ 
20 multi-media ot>jects whfch comprise the print medium types of: articles, pictures, 
and layouts, as well as the multi-media types of: run time nrx>vies, animation, pop- 
up menus, interactive queries, audfo, nrK>ving objects, and any other dynamic data. 
The integration of the multi-media types of data into the multi-media presentation 
to create a multi-media mutti-media presentation is accomplished by adapting the 
25 existing print niedium publication management system to the nmilti-n>edia 
environment in a manner that is transparent to the staff members and extends the 
features available to the print medium to the nr>ulti-media environment This 
transformation is accomplished by the use of multi-media presentation file classes 
whk:h serve the various multi-media multinmedia objects. These additional classes 
30 are seamlessly incorporated into ti>e multi-media presentation control environment 
of print medium classes by the use of mutti-media presentation file administration 
processes which create custom headers for these murtknedia multi-media objects 
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and enable the staff members to define custom treatments for these new classes 

as is described below. 

Publication Process - Workflow Example 

Figure 2 illustrates an example of the woricflow when the multi-media project 
5 management and control system 20 is used to manage the muKi-media 
. presentation development process for a single multi-media object In particular, the 
retrieval, editing and production of a final instance of a single multi-media object is 
described to denote the steps taken by a designer/editor to develop a riiutti-media 
object for incorporation into the multi-media presentation. On another level, as 

1 0 described in more detail below, the plurality of multimedia objects are incorporated 
into the multi-media presentatbn by the multi-media presentationitigeneration 
system MPG. In fact, the multi-media presentation generation system MPG 
enables a designer to create some multi-media objects as well a^qsrocess a 
plurality of retrieved multi-media objects into the multi-media presentation. 

15 Therefore, Figure 2 illustrates a conceptual view of the process and ittie specific 
implementation of the editing, and devetopment steps noted therein may occur in 
any of a number of possible hardware/software systems that comprisecthe above- 
noted network that comprises the multi-media project management and control 
system 20. 

20 The leflrTK)St column of Figure 2 contains the sequence of steps performed 

by a designer/editor using the multi-media object editing unit 52. The rightnrx)st 
column contains the sequence of steps performed by a project designer using both 
the multi-media object assignment unit 40 and the project application software unit 
44. The center column contains a description of the actions perfbnmed by the 

25 project coordinator 24. 

As a preceding step P to ttiis process, a media developer generates a multi- 
media object and checks this object into the multi-media project management and 
continol system 20 where it is stored in file server 28. In step 200, having previously 
bgged on to the multi-media project management and control system 20, the 

30 project designer checks-out or creates a multi-media presentation project file 204 
which comprises a plurality of multi-nrvedia components, each of which comprises 
at least one muKiHDedia object. Subsequentiy, using the multi-media object 
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assignment unit 40, the project designer assigns a multi-media project component 
208 to a specific designer/editor. This results in a multi-media object file 212 
automatically being created with information containing, among other things, the 
identification of the designer/editor to whom the multi-media project component is 
5 assigned, the due date for the multi-media project component and a designation 
of the nature of the multi-media project component Reference data is also inserted 
into the project file 204 associating ttie multi-media object file 212 witti the multi- 
media project component 208. Once these actions have been accomplished, the 
project coordinator 24 can automatically notify the specified designer/editor of the 

10 new multi-media project component assignment In step 220, the project designer 
then checks-in the project file 204. In step 224, when the designer/editor assigned 
to develop the multi-media objects corresponding to the nKilti-media object file 21 2 
receives notification of the assignment, the designer/editor uses the multi-media 
object editing unit 52 to check-out ttie multi-media object file 212, via the muW- 

15 media object retrieval unit 56. Upon receiving the multi-media object file 212, ttie 
multi-media object editing unit 52 automatically displays the first page of the multi- 
media project component 208. m 

When the multi-media project component 208 is completed, the multi-media 
object file 212, containing the newly entered multi-media project component, is 

20 checked-in to the project coordinator 24 in step 228. If the project designer has the 
project file 204 checked-out, tiien ttie check-in of the multi-media object file 212 
automatically causes a notification to be sent to the project designer indicating that 
the multi-media project component 208 has been updated. Othenvise, tiie project 
designer is automatically notified that the multi-media project component 208 has 

25 been updated wheneverthe project designer checks-out ttie projectfile 204. Thus, 
when ttie project designer again checks-out the project file 204 via the project 
application software unit 44 in step 232, the automatic notification of a change to 
the multi-media object file 212 provkles ttie impetus for the designer to request an 
update to the project file 204 and its display via the project application software unit 

30 44. 

Independent of the actions of the project designer, the designer/editor again 
checks-out the multi-media object file 212 to edit it using ttie multi*media object 
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editing unit 52. In step 240. tlie designer/editor checl(s-in the multi-niedia object 
file 212 with a designation that it should t>e routed to a second designer/editor for 
review. A notification is automatically sent to the project designer indicating the 
multiHfnedia object file 212 has changed and. in addition, if a second designer/editor 
5 is logged on to the multi-media project management and control system 20, then 
a notification is automatically routed to the second designer/editor ttiat the multi- 
media object file 212 is available for review. Upon notification in step 244. the 
second designer/editor checks-out and also edits ttie multimedia object file 212 
using the multi-media object editing component 52 residing upon their processor. 

1 0 In step 248. tiie second designer^editor also checks-in tiie rntilti-media object file 
212. In step 252. when tiie project designer again checks-dut tiie pnaject file 204 
via the project application software unit 44, tiie designer isthotified of the multi- 
media object file 212 change and can therefore requestthat dtf updated versfon of 
tiie multi-media object file 212 be incorporated into tiie projectfile 204. in step 256. 

15 the project designer subsequentty deckles to retocate ttienmuKi-media project 
component 208. Once notice is given to the project coordinator 24 of ttie project 
file 204 changes, tiie new geometry tor the multi-media projed component 208 is 
automatically written to the mulb'-media object file 212. Subsequentiy. assuming 
the designer/editor assigned to the article is logged on to the multi-media project 

20 management and control system 20 and has either checked-out ttie multi-media 
object file 212 or provkJed ttie date controller 32 witti a query notification allovtring 
ttie designer/editor to be notified whenever the geometry of ttie multi-media object 
file 212 changes, ttie project coordinator 24 automatically generates a notification 
whk^ is sent to tiie assigned designer/editor indicating tiiat ttie geometiy for ttie 

25 multi-media project component has changed. In step 260, ttie assigned designer/ 
editor checks-out the multi-media object file 212 to modify ttie multi-media project 
component 208. In step 264. ttie designer/editor checks-in ttie new versbn of tiie 
mufti-media object file 212. As before, the project designer is automatically notified 
of ttie multi-media object file 212 change whenever the project file 204 is checked- 

30 out Thus, in step 268 when the project designer checks-out the project 204. ttie 
project designer is notified of a new versbn of ttie multi-media object file 212. 
Rnally. once all new multi-media objects have been incorporated into ttie project. 
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the project designer In step 272 sends the project file 204 to the designated 
medium (not shown). 
Prelect Coordinator Details 

Figure 3 illustrates a more detailed view of the project coordinator 24. In 
5 particular, Rgure 3 discloses the data flows between the data repositories and the 
utilities 36, The file server 28 accesses the followng files residing on the storage 
device: a configuration file 300 containing data required toinitialize the multi-media 
project management and control system 20, the multi-media object files 304. and 
a collection of header file fonmat files 318 for interpreting thefile header infomiation 
10 residing in each multi-media object file 304. More precisely, the configuration file 
300 provides: 30 

(1 ) the list of multi-media presentations known to the multi-media project 
management and control system 20; 

(2) multi-media presentation access data specifying the access 
15 privileges of staff members to various multi-media object files 304; 

and 

(3) the file server 28 path names to the locations where the multi-media 
object files 304 are stored on the storage device. 

Each multi-media object file 304 includes at least an item file header 
20 providing infomiation about the contents of the file, a content area giving the multi- 
media object content data and a geometry area providing the data designating the 
location, orientation and shape of the multi-media object. Each item file header 
includes at least the following fields: 

(1) a file name field giving the name for this item multi-media 
25 presentation file 304 by which the file server 28 can identify it; 

(2) an Item name field providing the name by which the multi-media 
object Is displayed and known to a staff member; 

(3) a check-out name field providing the identification of a staff member 
that has this multi-media object file 304 checked-out for exclusive 

30 use; 
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(4) a multi-media presentation name field providing the name of the 
multi-media presentation within which the multi-media object is t>eing 
published; 

(5) a section name field providing the name of the section within the 
multi-media presentation where the multi-media object is being 
published; 

(6) a date due field providing the date of the next multi-media 
presentation deadline for the multi-media object; 

(7) a content time stamp field providing the last date and time the content 
area was modified; 

(8) a "routed-to" name field providing the name of a multi-media project 
management and control system 20 staff member to whom 
notification is given of the availability of the multi-media object file 304 
upon check-in of the file assuming the routed-to staff memt>er has 
established an appropriate query notification with the data controller 
32; 

(9) a status level field allowing a publisher to specify a status for the 
multi-media object; and 

(1 0) any optional publisher specified fields desired. 
Data Controller ^ 

The data controller 32 includes the following submodules: a multi-media 
presentation access controller 320» a multi-media object controller 324. a query 
evaluator 328 and a notification controller 332. The multi-media presentation 
access controller 320 controls access to the project coordinator 24 by establishing 
the validity of a staff nriember's logon name and password. In addition, the multi- 
media presentation access controller 320 also establishes the authorization of a 
staff member to access the multi-media objects 304 related to a selected multi- 
media presentation. Once access to the project coordinator 24 is granted, access 
privileges are checked to determine which multi-media presentation, multi-media 
presentation section and multi-media object type a staff member can potentially 
access as tong as the multimedia project management and control system 20 
client applicatton being used by the staff member can process the multi-media 
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object file type. To coordinate staff meml>er requests to modify multi-media object 
files 304, the multi-media object controller 324 controls access to the multi-media 
object files 304 primarily by controlling access to the infomiation contained in the 
item file header as is described below. To facilitate further coordination anrong 
5 multi-media project management and control system 20 staff members, the query 
evaluator 328 evaluates queries generated by requestors regarding item file header 
infomnation. The notification controller 332 also facilitates staff member 
coordination in ttiat it provides a requestor with the capability to be automatically 
notified when certain project coordinator 24 events occur via the file notification and 

10 query notification capabilities. For instance, a requestorJOf a file notification is 
automatically notified whenever the notification controller 332 detects a change in 
a specific multi-media object file 304. In a publishing context, the predetemnined 
event type changes for a mufti-media object file 304 include^^hanges to the item file 
header, changes to the content area, changes to the geometry area, deletion of the 

15 mufti-media object file 304, check-in and check-out of thei^ihufti-media object file 
304. 04. 



controller 32. Each of these data stores contain infbmDation required by at least 
one of the above submodules 320-332 of ttie data controller 32. A descriptton of 
20 each of the data stores folk>ws: 



Rgure 3 illustrates a pturalfty of data stores 336-362 connected to the data 



(1) 



A collection 336 of mufti-media presentation identification records 
364, each of which contains the klentification of a multi-media 
presentation kriown to the mufti-media project management and 
control system 20. 



25 



(2) 



A collection 340 of access records 368, each of which contains the 
klentification and mufti-media presentation access privileges of a staff 
member. 



(3) 



A collection 344 of file location patti records 372, each of which 
contains a character string identifier giving the file server 28 path 
name to a storage area on the data storage device where mufti- 
media object files 304 are stored. 



30 
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A collection 348 of header location records 376, each of which 
contains information designating the location of the item file header 
308 within a specific type of multi-media object file 304. 
A collection 352 of item header records 378, each of which is a copy 
of an item file header. 

A collection 356 of item file header fomiat records 384, each of which 
provides a description of the format of an item header record 378, 
equivalently, an item file header. 

A collection 360 of watch records 388 which is rjiaintatned by the 
notification controller 332. Each valid watch record 388 contains the 
information necessary to allow the notification controller 332 to do 
either a file notification or a query notification when a project 
coordinator 24 event related to the watch record 388 occurs. 
A collection 362 of item summary records 42Q^ each of which 
provides access to substantially all information residing on the data 
controller device relating to a specific multi-media object file 304. 
included in the utilities 36 of the project coordinator 24 is a start-up utility 500 
which initializes the data stores 336-362. Following execution of the start-up utility 
500, the logon utility 504 must be used in orderfor a potential staff memt>erto gain 
20 access to the multi-media project management and control system 20. Thus, the 
logon utility 504 can be invoked from any processor in the networked system of 
processors whteh comprise the publishing system, and executes on each such 
processor with the multi-media presentation access controller 320 detenmining a 
staff member's access privileges. Once a staff member is logged on, a multi-media 
25 object file 304 can be checked-out via the check-out utility 508 or, if already 
checked-out then subsequently checked-in via the check-in utility 51 2. Thus, upon 
invoking the check-out utility 508 from the staff member's processor, the utility 
communicates with the multi-media object controller 324 to gain multi-media object 
access and with the file server 28 to retrieve a copy of the related multi-media 
30 object file 304. Conversely, upon invoking the check-in utility 512 from the staff 
memt)er's processor, the check-in utility communk^es with the multi-media object 
controller 324 to release the staff member's exclusive access to the checked-out 
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multi-media object file 304. and subsequently provides the file server 28 with a new 
version of the multi-media object file 304 to be written to the storage device. As an 
altemative to checking-out a multi-media object file 304, the edit header utility 51 6 
can be used to modify Hem file header 308 fields concunentiy and substantially 
5 independentiy of tfie use of the check-out and check-in utilities 508, 512. A staff 
HDember invokes the edit header utility 516 from their processor, after which the 
utility communicates witii the multi-media object controller 324 to obtain the desired 
item header record 378. Once obtained and modified as desired, the edit header 
utility 51 6 communicates the new header infbmiation to both th§ file server 28 and 

10 the multi-media object controller 324 to ovenvrlte the Kem fileih^der 308 and the 
item header record 378. respectively. The request notificatiomotility 520 allows a 
requestor to request eittier file notifications or query notifications from the 
notification contrdier 332. Moreover, note that such notifications can be set 
manually or automatically depending on whether the request notification utility 520 

15 is invoked consciously by the staff member or the utility is invoke as a skie-effect 
in response to some staff member action. While such a notifk:ation remains in 
effiect, the requestor can be repeatedly notified of project coordinator 24 events 
relevant to the set notification request The receive notification utility 524, 
preferably also reskiing on each processor, receives the notifications generated by 

20 the notification controller 332. Once a notification is received, the receive 
notification utility 524 determines whether sufficient information has been received 
to effectively allow the requestor to respond to the notification. 
Page Based Document Lavout Systems 

Page based document layout systems are known fertile print medium, and 

25 one such system presentiy available is titied "QuarkXPress,* produced and 
distaibuted by Quark, Inc. This page based document layout system partitions 
document pages, as defined by the auttior, into a plurality of objects (also temied 
boxes and lines), each of which is independentiy editable by ttie auttior. The page 
based document layout system coordinates and manages ttie inputting of data into 

30 the plurality of objects and ensures ttiat the populated objects are integrated into 
the final docunrient page layout The data that are input into these objects are static 
in nature. In that the data comprises print data: textual infbnmation and/or graphics. 
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These types of data, when combined into the document page layout, represent the 
final presentation which is static in nature, being comprised of a plurality of static 
objects. This page based dooiment layout system is menu driven, in that the 
author simply selects object characteristics from a set of menus to control the 
5 layout, content and presentation of the document page that is created. In this 
manner, the author can simply create a document and precisely regulate Its 
presentation characteristics without the need to use complex programming 
languages. In addition, this system is layout driven in that the publication item is 
partitioned into a plurality of extents, whose contents are cusfom developed to fit 

10 the boundaries defined for the associated extent. bo 

The mutthmedia presentation generation system illustrated in Rgure 4 uses 
a multi-media authoring tool to extend the capabilities of the pai^e based document 
layout system to the content driven paradigm of multi-medi^t and to enable an 
author to merge both static and dynamic objects in the femiltap page based layout 

1 5 environmentto create the multi-media presentation. The dynamic objects available 
to the author include, but are not limited to: run time movieis^ animation, pop-up 
menus, interactive queries, audio, nfx>ving objects, and any other dynamic data that 
the author desires to include in the multi-media presentation. aThe selection of the 
various objects which comprise a page of the final multiHTiedia presentaton and the 

20 regulation of the object characteristics is accomplished in a menu based authoring 
environment maintained by the multHmedia authoring tool. This system also 
enables the author to take existing documents prepared for a print medium and 
convertthem to multi-media presentations. Anotheradvantage of implementing the 
multi-nDedia presentation generation system as an extension to the existing page 

25 based document layout system is that the tools and environment available in the 
page based document layout system are substantially the same tools available in 
the multi-media environment to layout and manipulate the multi-media 
presentations. 

The multi-media authoring tool assigns a unique identification to each object 
30 that has multi-media infbnmation and that is located in the multi-media presentation, 
in the fonn of hidden infbnmation, to distinguish it from all static objects created in 
the presentation. The hidden infbnmation associated with each object defines the 
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unique multHnedia characteristics of the images displayed in the object and this 
hidden information is maintained by but is not necessarily accessed by the page 
based document layout system. Thus, the multi-media nature of these objects is 
transparent to the page based docunr)ent layout system. The multi-media 

5 presentation generation system then creates an export object using this hidden 
Infonnation, and identifies the ownership of this object (page, window, no 
ownership, and the like) by considering the geometry of the object^: This geometry 
information is defined by the page based document layout systemiovhich functions 
to regulate the spatial relationships among the plurality of objectsatontained within 

10 the multi-media presentation. Iti-r 

Thus, the multi-media presentation generation system u§bs a multi-media 
authoring tool extension of a page based print document layout system to combine 
media objects of multiple diverse types into an integrated multi-medja presentation. 
This system enat>les the author to take existing documents prepared for a print 

15 medium and convert them to mutti-media presentations. Another advantage of 
implementtng the multi-media presentation generation system asran extenston to 
the existing page t>ased document layout system is that the tools and environment 
available in the page l>ased document layout system are substantially the same 
tools available in the multi-media environment to layout and manipulate the mutti* 

20 media presentations. This system operates without the complex frame based, 
script language environment of some prior systems, since it is based on a desktop 
publishing environment There is also no need for programming expertise to author 
multi-media presentations. This system does not require the author to work on 
togteal and visual abstaractions of botii objects and the viewable screens on whidi 

25 ttiey appear. Thus, the multi-media presentation generation system of the present 
invention 

Basic System Architecture 

Figure 4 illustrates, in block diagram fomri. an architectural diagram of a 
mutti-media presentation generation system which comprises a menu driven multi- 
30 media presentation generation system MPG, executing on a processor P. whteh 
accesses data from any of a multitude of media sources S1-S6. which data is in 
any of a multitude of fomiats and contents for integration into an adaptable product 
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which represents the multi-media presentation. The basic architecture of the mutti- 
HTYedia presentation generation system is a multi-media authoring tool which 
operates in conjunction with a page based document layout system to extend the 
menu based, static object manipulation capability of the page based document 

5 layout system to encompass dynamic multi-media objects. ) 
One element of this multi-media presentation generation system MPG 
comprises a page based document layout system Q which functions to define the n 
basic workspace for the user into which the plurality of media objects are imported. it^ 
In particular, ttie page based document layout system Q includes a page layout y 

1 0 capability which enables the user to define a workspace of predetemnined physical vs 
extent, generally in a two dimensional nrKxle, whteh workspace is divkled by the 
user into a plurality of objects. Each of these objects comprise a segment of the )j( 
workspace and do not have extents that project beyond the boundaries of the -t 
workspace. The plurality of objects in the workspace are either disjunct, or overiap 

15 or are physically contiguous within the woricspace. The user defines the content :e 
and function of each of these workspaces indivkJually as well as their integration ± 
with the other objects in the woricspace to fomri the entirety of the presentation. nf 



The multi-media presentation generation system MPG also comprises a 
software extension feature QC which functions to interconnect the page based 

20 document layout system Q with at least one source of media objects S1-S6 and 
with a multi-media authoring tool A. The multi-media authoring tool A is 
interconnected with the page based document layout system Q via the existing 
published interfaces of the software extensbn feature QC of the page based 
document layout system Q. This system could alternatively be accomplished by 

25 wrapping the multi-media auttxHing tod A direcHy into ttie page based document 
layout system Q, without It having to be an extension. In either case, the multi- 
PDedia authoring tool A operates in conjunction with the page based document 
layout system Q to extend ttie menu based, static object manipulation capability of 
the page based docunrtent layout system Q to encompass dynamic multi-media 

30 objects. The dynamic objects each comprise viewable data which is presented 
pursuant to a set of parameters, which regulate the generation and presentation 
of the resultant images independent of the ottier objects which comprise the multt- 
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media presentation. These dynamic objects produce their images in their defined 
extent without requiring the regeneration of the remainder of the presentation 
image. 

The sources of media objects S 1 -S6 are graphics downloaded from external 
5 sources, such as CD-ROM S1 or disk drive S2, graphics generated by additional • 
software resident on the processor P or graphics that are scanned Into the system P 
via a peripheral device. Furthemrx>re, video information likewise is obtained from ore 
a plurality of extemai sources including, but not limited to, data communication luc 
connectfons S4 to the file server 28 of the multi-media project management and ?8 t 

1 0 control system 20 or to broadcast media, such as Internet or broadcast television, nie 
vkJeo tape recorders S3, or live feeds S5 from a camera or other such appropriate ^ds 
source of video infbnmatfon. Audio infomnatton is input to the multi-media ^ud 
presentatfon generation system MPG via microphone S6, radto receiver, data VIP 
communicatk>ns source S4 or any similar audk) source of data. The textual ny 

15 in1brmatk>n is directly input by the user into the page based document layout \. 
system Q or is obtained from a word processor or from a data communication vor 
source S4 or a peripheral device, such as a document scanner The above-noted ^ac 
data also includes audk>/video files and still images. These types of media and the > 



media sources are simply noted herein to indicate the diversity of infonmation whic^ 
20 is used by the multi*media presentation generatk)n system MPG to perform the 
multi-media object creatk>n. 

Underlvino Page Based Document Layout System 

The underiying page based docun^ent layout system is a menu based 
system whfch functions to partitfon document pages, as defined by the author, into 

25 a plurality of objects (also termed boxes), each of whteh is independently editable 
by the author. The page based document layout system coordinates and manages 
the inputting of data into the plurality of objects and ensures that the populated 
objects are integrated into the final document page layout 

For the purpose of iWustratfon, the page based document layout system Q 

30 illustrated in Rgure 4 is the commercially available QuaricXPress product 
QuarkXPress is document publishing software which is used to create a multi- 
media presentation in a print medium. The QuariOCPress system enables a 
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designer to plan and design a print multi-media presentation. The designer seletits 
the page size, margin widths, number of columns, type faces, type styles, color, 
and the like. This system includes word processing capability to enable an editor 
and/or designer to cut, copy, paste and delete text. The graphic artists use this 
5 system to create the illustrations, photographs and other graphic elements whidi ' > 

accompany the texL The system imports scanned static pictures and computer aor 
generated graphics. These various static elements are combined via page layout ati 
features, including the use of templates, to enable a created page format to be ^tes 
used repeatedly on various documents. Typographic polishing is available to nts 

10 precisely adjust word and character spacing, hyphenation and justification. 3r 
Imported pictures are framed, rotated, skewed, resized cropped, and the like. ^d. 
Background cobr Is available as well as text run around capability to wrap text il a 

arournJ ptetures and illustrations. 

The QuaricXPress page based document layout system Q utilizes boxes and doc 

15 lines to manage the document space. The multi-media authoring tool A also uses 

the boxes and lines of the page based document layout system Q. but for muiti- ^ci c 

media content, with the hidden infonmatton whk:h defines the multi-media content lati 
and attributes of these boxes and lines being stored therein to distinguish the multi- > be 

media objects. Therefore, the term "object" as used herein encompasses the "o 

20 boxes, lines and the like, whether or not their content is multi-media in nature. The 
objects comprise the user definable space into which the viewable content is placed 
for incorporatk>n into the document The objects have both a position (k)cus) on 



the document page and an extent in the two dimensk>nal space of the document 
page. In partkxilaK text is contained in text objects QTB while pictures are 

25 contained in ptoture objects QGB. Therefore, to place text in a partk:ular location 
on the document page, a text object QTB must be created at this site. Text objects 
QTB and picture objects QGB are the basic building blocks of a document When 
an object is active, the user modifies it using the controls listed in the text object 
QTB spectficatk>ns or pkrture ot>ject QGB specifk:atk>ns. The text objects QTB, 

30 picture objects QGB and lines on a QuaricXPress page behave in much the same 
way as the halftones, galleys of type and press-on rules used in traditional 
production environments: each item Is either in front of or behind other items. The 
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"Stacking order is a term which refers to the front/back relationships among the 
various items of a page layout An object that is in front of another item obscures 
the item behind unless the object has a background color of "none" which renders 
the object transparent, except for its contents. The multi-nDedia authoring tool A 
5 uses these properties of objects, managed by the page based document layout 

system Q, to author the multi-media presentation. A plurality of menus are ^3 
provkled to enable the user to edit and manage the document its various pages ^nc 
and the objects that are created for placement thereon. Each menu displays P 
entries which are grouped according to the operation that they perfomi. 3 to 

10 Extensions To The Page Based Document Layout Svstem oci 
QuarkXPress has an open architecture that enables a developer to add new ^hit 
functions and features to the bask: page based document layout system Q. This ^^g 
function and feature addition is accomplished by use of the paradigm known as om 
extensbn software QC. which is an interface which incorporates extension 

1 5 modules, each written using a standard set of instructk>ns, into the underiying page ^ rd 

based document layout system Q. The extension nrKxJule is treated as part of the ~ne 
basic page based document layout system Q, since it is written using the ut 
predefined set of program instructions and is formatted to be compatible with the ^> 
page based document layout system Q. As with any instruction set there are 

20 standard definitions of the functions, the retum types, paranieter types, data 
structures and the like. The page based document layout system Q, upon being 



launched, opens the extensbn modules in its home fokler and passes opcodes to 
the extensbn nrK)dules to provkte an indbation of the present state of the 
processor. The extension modules review the received opcodes to determine 

25 whether they represent a stimulus to which this specific extensbn nxxiule is 
programmed to respond. If so. the extensbn module perfomns the programmed 
action(s}. Multiple extension nxxlules are capable of being operational on the 
same processor and also operate on ttie same document which is created. 

The multi-media presentation generation system MPG is implemented as the 

30 addition of at least one extensbn module (such as multi-media authoring tool A) to 
the page based document layout system Q. This multi-media auttiCMing tool A 
makes use of the features and capabilities of ttie page based document layout 
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system Q and adds multHnedia capabilities to these features. One advantage of 
implementing the multi-media presentation generation system MPG as an 
extension to ttie existing page based document layout system Q Is that users who 
are ^miliar with the tools available in the page based document layout system Q 
5 use the same tools in the multi-media environment to layout and manipulate the 
multi-media presentations. In addition, the capabilities of the page based 
document layout system Q are available to the user, including, but not limited td! 
precise placement of objects, grouping of objects, master pages, control of dll 
aspects of text manipulation, use and control of color, and the like. Furthermore 

10 ttiis system enables the author to take existing documents prepared for a pHrft 
medium and convert them to multHnedia presentations. ^he: 
The expansion of the various objects of ttie page based document layooi 
system Q by means of the extensk>n software QC results in documents becomfrt^ 
multi-media presentations, with document pages corresponding to multi-media 

15 display screens. In addition, the QuarkXPress objects (text and picture objed^j 
lines, and the like) of the page based document layout system Q become mulfi^ 
media objects, such as: buttons, hot areas, text objects, movies, animations, pdp^ 
up menus, windows and the like. The text becomes "hot texT that performs f^a 
desired action when the user positions the cursor on the hot text and clicks ttie 

20 mouse. Thus, the multi-media presentation generation system MPG is an 
extension to the existing page based document layout system Q whk:h expands the 
static elements of the page based print environment to dynamic elements of the 
multHnedia environment In addition, the mutti-media presentation generation 
system MPG is itself extensitrfe to enable devebpers to add features to the basic 

25 program in a manner anafogous to the extension capability of the page based 
document layout system Q. 

System Operation For Multi-Media Presentation Creation 

In operation, the user typically interacts with the multi-media presentation 
generation system MPG by means of a keyboard K and/or a mouse M or other 
30 such user input device. In particular, as shown in flow diagram form In Rgure 5, ttie 
user activates the multi-media presentation generatton system MPG at step 501 
and is provided with a prompt to thereby enable the user to define a baseline point 
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of reference, such as a page layout In step 502, the user specifies the extent of 
the workspace which represents the final image that is produced for the end user. 
The multi-media authoring tool A of the multi-media presentation generation system 
MP6 displays the queries on the display device D that is part of the system to 
5 enable the user the view the prompts from the multi-media presentation generation 
system MPG and respond thereto by inputting data via the keyboard K and/or 
mouse M. The user thereby defines the basic parameters with'which the multi- 
media presentation generation system MPG must wortc. In a typicatapplication, the 
designerdefines a presentation display device D of certain size and Characteristics. 

1 0 The designer therefore defines the page layout to comprise the pl:^sical extent of 
a display devk:e, which has certain technical characteristic^^such as color, 
resolution, etc. Once the user has defined ihe basic page extent}ithe multi-media 
authoring tool A prompts the user at step 503 to define the pimality of regions 
(objects) within the woricspace into which various objects are to be)inserted. These 

15 objects are typically retrieved from the file server 28 of ttie multt^media project 
management and control system 20 whteh comprises a repository^of multi-media 
objects for use in the project devebpment process. for 

The multi-media authoring tool A at step 503A provides the user with a set 
of menus via the display devrce D to enable the user at step 503B to define the 

20 number and physical extent of the regtons within the woricspace. In defining the 
regbns of the workspace, the user is not constrained to select a single media type 
for use in tt^at region but can have multiple concun^ntiy active media types wittiin 
a single workspace and within a single region of the woricspace to thereby enable 
a plurality of multi-media presentations to concurrentiy be extant on the user's 

25 display. Since the underiying document layout system Q is page based, the 
definition of the woricspace is described herein in terms of a page and portions of 
a page to ttiereby simplify the understanding of the invention. However, there is 
no Inherent limitation in the architecture of the multi-media presentation generation 
system MPG that requires limitation of the invention to a physical page of 

30 infonnation or a print medium which typk^ally is implied by the use of the word 
"page." Indeed, given that the end product is muttinmedia in nature, the output can 
be destined for a display medium that is print in nature or audtovisual or mutti- 
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media, in the form of a computer display. Regardless of the fomi of the display 
medium* the multi-media authoring tool A functions to automatically integrate a 
plurality of source modules into a dynamic presentation with the objects used to 
populate the presentation screen being independent of yet integrally coupled to the 
5 page based document layout system Q via the connection software QC. 
Implementation of Various Multi-M edia Obfects 

The following description notes the effects of the user selecting various 



objects in this system. In this description, the menu paradigm includes the palette 

which is produced by the multi-media presentation generation system MPG. This n 

1 0 palette consists of several panels, a number of whi6h are described below. h 

Page Panel - When the user of the multi-media presentation generation h 

system MPG selects the Page panel of the palette and specifies the display and t6 

action specifics of tills element, the page definition data is transmitted from the ic 
multi-media authoring tool A to the page based document layout system Q, where 

15 the page definition data is stored inside the QuariOCPress page. The multi-media 

authoring tod A retrieves this stored page definition data for display and editing t>y :»r 

the user. The page definition data is also retrieved from storage when the multt- e 

media presentation is activated or exported, with this data being used to define the n 

multi-media presentation as is described in additional detail below. o 



20 Object Panel - When the user of the multi-media presentation generation 

system MPG selects the Object panel of the palette and specifies ttie display and 
action specifics of this element, the object definition data is transmitted firom the 
multi-nnedia authoring tool A to the page t>ased document layout system Q, where 
the object definition data is stored inside a connesponding QuariO(Press object The 

25 multi-media authoring tool A retiieves this stored object definition data for display 
and editing by the user. The object definition data is also retrieved from storage 
when the multi-media presentation is activated or exported, witti this data being 
used to define the multi-media presentation. There are typically limitations on the 
object definitions which represent constraints of the system. For example, a text 

30 object is used to Implement multi-media objects which include: basic, animation 
Otem on a path), pop-up menu, text object and window. A picture object is used 
to implenr>ent multi-media objects which include: basic, animation (any kind), nrK>vie, 
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pop-up menu and window, while a line is used to implement muttknedia objects 
which include: basic, animation (item on a path). Furthemnore. button objects are 
created through a button library pixel editor which is resident in the multi-media 
authoring tool A and are similar to picture objects in the page based document 
5 layout system Q. 

Script Panel - When the user of the multi-media presentation generation yec 

system MPG selects the Script panel of the palette and specifies the display and \e\ 

action specifics of this element, the script definition data is transmitted from the -e s 

multi-media authoring tool A to the page based document layout system Q, where pac 

10 the script definition data is stored inside the QuarkXPress document. The muKi- nsk 

media authoring tool A retrieves this stored script definition data for display and us 

editing by the user. The script definition data is also retrieved from storage when nitic 

the multi-media presentation is activated or exported, with this data being used to vat 

define the multi-media presentation. The script definition data is saved to a file and ^ . T 

1 5 also loaded into the multi-media presentation from a file. ese 

Hot Text Panel - When the user of the multi-media presentation generation ise 

system MPG selects the Hot Text panel of the palette and specifies the display and ane 

action specifics of this element, tiie hot text definition data is tiransmitted from the ^ h 

multi-media authoring tool A to the page based document layout system Q, where :>3: 



20 the hot text definition data is stored inside the corresponding QuarkXPress text 
element. The multi-media authoring tool A retrieves this stored hot text definition 
data for display and editing by tiie user. The hot text definition data is also 
retrieved finom storage when the multi-media presentation is activated or exported, 
wrtti this data being used to define the multi-media presentation. In addition, 

25 hklden text maricer characters are placed at the beginning and end of the text 
selection range of the text to delineate the hot text object Additional hidden text 
is stored within the range defined by these delimiters to describe the user events 
and actions that are associated with this hot text item. This additional text is 
typteally stored immediately f6lk>wing the beginning maricer character. 

30 Keys Panel - When the user of ttie multi-media presentation generation 

system MPG selects ti>e Keys panel of the palette and specifies a key command, 
the key and script data is tiransmitted from the mutti-media autiioring tool A to the 
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page based document layout system Q, where the keys definition data is stored 
inside the corresponding QuarkXPress page or master page. The multi-media 
authoring tool A retrieves this stored keys definition data for display and editing by 
the user The keys definition data is also retrieved from storage when tiie multi- 
5 nr^ia presentation is activated or exported, with this data being used to define the 
mutti-media presentation. ^tic 

Referenced Files - The multi-media presentation generation system MPG 
references other files which reside outskle of the boundaries of the multi-media 
presentation generation system MPG and ttie multi-media presentation which* is 

1 0 generated by this system. These referenced files are any of a number of type^of 
files* stored in various locations, which include, but are not limited to: sounds, 
QuickTime™ movies, animations, cursors, index files, ottier muW-m^ia 
presentations, EPS files, AppleScript™ files. Reference infbmiation fbrthese'files 
is ta^nsmitted firom the multi-media authoring tool A to the page based document 

15 layout system Q, where the reference data is stored inside the corresponding 
QuarkXPress document The multi-media authoring tool A retrieves this stored 
reference data for display ar>d editing by the user. The reference data is also 
retrieved firom storage when the multi-media presentation is activated or exported, 
with this data t>etng used to define the mutti-media presentation. < ^ 

20 Authoring in the Multi«Media Authoring Tool 

The multi-media authoring tool A extends the features and capabilities of the 
underiying page based document layout system Q to address the multi-media 
objects used by the multi-media authoring tool A. In particular, the menu capability 
of the underiying page based document layout system Q is expanded by the multi- 

25 media authoring tool A to include menus which list the multiple types of media that 
are available firom the media sources S1-S6 as well as the editable and 
presentation characteristics associated with each media type. The underlying page 
based document layout system Q is equipped witii standard well-defined interfaces, 
via the extensbn software QC, which enable the multi-media authoring tool A to 

30 integrate its features and user interfaces with the underiying page t>ased document 
layout system Q. 



-26- 



wo 99/04370 



PCT/US98A14474 



The multi-media authoring tool A creates at step 503C QuarlcXPress 
documents with additional infbmnation appended thereto, temned "hidden 
infbmnation," which additional infbnnation relates to the objects placed on the pages 
of the multi-media presentation. The multi-media authoring tool A sometimes 
5 places a header on the created page, which header uniquely identifies the page as 
part of a multi-media presentation. In addition, each object with multi-media 
information that is created and located on the identified page is assigned a unique 
identification to distinguish it from all other objects created in the system. The 
hidden information associated witii each multi-media object corftalns data which 

1 0 defines the unique multi-media characteristics of the presentatiortdisplayed in the 
object and this hidden infomiation is not accessed by the page based document 
layout system Q. Thus, the muKi-media nature of these objects |^ transparent to 
the page based document layout system Q and yet tiiese objectseate managed by 
the page based document layout system Q at step 503D using; its existing page 

1 5 layout capabilities. ::ap 

The objects created by the multi-media authoring tddMare therefore 
transparent to the basic layout system due to the transfomnation process executed 
as described above. These objects are used by the multi-media multi-media 
presentation managennent and control system 20 as the multi-media objects in the 

20 manner noted above. At step 504, the user outputs ttie resultant multi-media 
presentation to the selected medium for storage thereon. The process then exits 
at step 505. 
Summary 

Thus, tiie multi-media presentation generation system is operable the 
25 multi-media project management and control system, which functions to manage 
the development of a muttinnedia presentation by controlling the task assignments 
associated with the retirievai, developnient and integration of the plurality of multi- 
media objects which comprise the multi-media presentation. The multi-media 
presentation is content driven rather than layout driven as in the print medium case 
30 and the management of tt>e multi-media project must follow tiiis different paradigm. 
The implementation of tiie multi-media object generation and editing functions can 
be witiiin the multi-media presentation generation system or can be implemented 
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in othersoftware components extant on the processors which comprise the networic 
that is used to implement the multi-media project management and control system. 
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WE CLAIM: 



1. An apparatus for ccx)rdinating access among a plurality of staff 
nnembers, who work together to produce multi-media presentations, to a plurality 
of multi-media objects of a multi-media presentation which comprises at least one 

presentation page, said at least one presentation page capable of being rendered ^ a [ 

5 as a multi-media display on a display deyice, said apparatus comprising: Mav 

means for produdng a page layout for a presentation page, said page layout e la 

comprising a plurality of multi-media objects, each multi-media object having ted 

header, content and geonietry sections which define multi-media object / s 

characteristics, a content of an image created from said multi-media object, and a age 

10 \ocus of said image created from said multi-media object on said multi-media n s 
display, respectively; 

means for defining at least one multi-media object for inclusion In said st c 
presentation page, comprising: 

means for identifying a multi-media object, g a 

1 5 means for presenting a set of multi-media object characteristics to an g a 

author for said identified nmjiti-media object, uiti 



means for associating, in response to said author selecting ones of 
said multi-media object characteristics for said identified multi-media object, 
said selected multi-media object characteristics with said identified muKi- 
20 niedia object; 

means for integrating said at least one multi-media object with said page 
layout to create said presentation page; 

means for coordinating access to said multt-media objects among a number 
of said plurality of staff members, each of said multi-media object content and said 
25 multi-media object header for a selected multi-media object being able to be 
accessed and modified simultaneously by a plurality of different staff members to 
achieve coordinated changes related to said selected multi-media object 
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2* The apparatus of daim 1 further comprising: 

means for defining a static image for inclusion in said presentation page, 
wherein at least two of said multi-media objects on said page layout define images 
which are static in content comprising: 
5 means for identifying each of said at least two static multi-media 

objects; 

means for rasterizing each said identified static muttiHnedia object; 

and 

means for combining said rasterized identified static muitiHnedia 
10 objects into a rasterized static image. a a 

3. The apparatus of daim 2 furttier comprising: ipp< 
means for rasterizing said at least one multi-media object; and iste 
wherein said means for integrating combines said rasterized at leastione 

mutti-media object wttii said rasterized static image to creato said multi-media 
5 display. 

4. The apparatus of daim 3 further comprising: ipp 
means for transmitting said plurality of multi-media objects which comprise 

said presentation page to a destination via a communication medium. \ \ 

5* The apparatus of daim 4 further comprising: 

means for activating a viewer, executat)ie at said destination, for executing 
said presentation page transmitted via said communication medium to said 
destination to create said muttnmedia display on a display device which is located 
5 at said destination. 

6. The apparatus of daim 3 further comprising: 
nneans for processing said presentation page to form a non-editable image 
for presentation to a user on said display device. 
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7. The apparatus of daim 6 further comprising: 

means for initiating a predefined action conBsponding to a user-selectabie 
locus on said non-editabie image, said user-selectable locus being activatabte by 
a user input device. 

8. The apparatus of daim 7 further comprising: 3 

means for translating, in response to a user selecting, via said user input 
device, a user-selectable locus on said image which is presented on said display 
device, said user initiated acUon connesponding to said user-sejectable locus into 
5 presentation of said data forming a one of said multi-media objects. 

9. The apparatus of daim 1 wherein said means for defining multi- 
media objects defines at least one of the dass of elements whic^ indude, but are 
not limited to: t>ackground, image, rasterized text, movie, non-rasterized text, 
window, animation, path for animation, pop-up menus, lists, interactive controls. 

1 0. The apparatus of daim 1 wherein said means for presenting said set 
of multi-media object characteristics indudes but is not limited to presenting: 
location, size, orientation, transformation, path and vetocityi of motion, color, 
content 
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